Music Discovery Dialogue Generation Using Human Intent Analysis and Large Language Model¶
A conversational music system can help users discover music that matches their preferences through interactive dialogue. To achieve this, the conversational music system should seamlessly engage in multi-turn dialogues by 1) understanding user queries and 2) responding with natural language and retrieved music. In this paper, we present a data generation framework for rich music discovery dialogue using a taxonomy of user intents, system actions, and music attributes and a large language model (LLM). We build the taxonomy by analyzing human music discovery dialogue through a qualitative method, and employ it for cascaded music database filtering and text prompt design to generate music discovery dialogues on the LLM. By applying this data generation framework to the Million Song dataset, we create -- LP-MusicDialogs, a Large Language Model based Pseudo Music Dialogue dataset, containing over 2M music conversations using more than 0.9M music items.
LP-MusicDialog Example
!important: Every audio file originates from the Million Song Dataset
!important: Every text in blue color is generated by the Large Language Model
!important: The dataset below is automatically generated without human intervention.
UUID: abd48351-ccc6-4748-8107-e47ea54b8e01
[intent]:initial_query,add_filter [music_attribute]:genre:punk
[USER]: I am interested in punk music.
[intent]:detail_attribute_request,passive_recommend
[SYSTEM]: To better assist you, could you tell me more about the specific characteristics of punk music you prefer?
| Title: Cheat Me | Title: Internal Release | Title: I love her | Title: Pervert | |
| Artist: Dogwood | Artist: Citizen Fish | Artist: Sham69 | Artist: Bouncing Souls_ The |
[intent]:add_filter,accept_response [music_attribute]:mood:rebellious
[USER]: I like rebellious punk music.
[intent]:parroting_response,passive_recommend
[SYSTEM]: Got it. I'll look for rebellious punk music that suits your taste.
| Title: Parasites | Title: Slave to My Dick | Title: Next To Go | Title: Pink Houses | |
| Artist: Subhumans | Artist: The Subhumans | Artist: Down By Law | Artist: Avail |
[intent]:add_filter,accept_response [music_attribute]:similar_track:Swing Life Away by Rise Against
[USER]: I enjoy the song 'Swing Life Away' by Rise Against. Any similar tracks you can recommend?
[intent]:detail_attribute_request,parroting_response,passive_recommend
[SYSTEM]: Could you provide more details about the attributes of 'Swing Life Away' by Rise Against that you like? I'll find some complementary tracks for you.
| Title: Anatomy Of Your Enemy | Title: Doomsday Breach | Title: I'd Tell You But... | |
| Artist: Anti-Flag | Artist: Only Crime | Artist: Anti-Flag |
[intent]:add_filter,accept_response [music_attribute]:mood:raucous
[USER]: I'm in the mood for some raucous music.
[intent]:detail_attribute_request,parroting_response,passive_recommend
[SYSTEM]: Let's search for some raucous punk music to match your current mood. I'll suggest a few tracks for you.
| Title: To The World | Title: Lights Go Out | Title: Extinguish | |
| Artist: Strike Anywhere | Artist: Strike Anywhere | Artist: Strike Anywhere |
[intent]:add_filter [music_attribute]:similar_artist:Strike Anywhere
[USER]: I'm a fan of Strike Anywhere. Can you recommend songs from a similar artist?
[intent]:feedback_request,sympathetic_response,passive_recommend
[SYSTEM]: It's great that you enjoy Strike Anywhere's music. I'll recommend some songs from a similar artist. Let me know what you think.
| Title: Savior | Title: Blood To Bleed | Title: But Tonight We Dance | Title: To Them These Streets Belong | |
| Artist: Rise Against | Artist: Rise Against | Artist: Rise Against | Artist: Rise Against |
UUID: a5373a1e-b5f6-438d-b489-40254c308171
[intent]:initial_query,greeting,add_filter [music_attribute]:genre:new age
[USER]: Hello! I'm interested in exploring new age music, particularly in the genre of new age.
[intent]:detail_attribute_request
[SYSTEM]: Could you provide more details or preferences about the type of new age music you prefer?
| Title: Quintessence | Title: Shine On Full Moon | Title: Lotus Love - Heart Centre (Regular) | Title: Rainbow Hoop | |
| Artist: Spencer Brewer | Artist: Gandalf | Artist: Aeoliah | Artist: David & Steve Gordon |
[intent]:add_filter [music_attribute]:mood:gentle
[USER]: Adding a filter for a gentle mood to my new age music selection.
[intent]:parroting_response,sympathetic_response,passive_recommend
[SYSTEM]: I understand your preference for a gentle mood. Let me suggest some soothing music for you.
| Title: Wings To Altair (1988 Digital Remaster) | Title: Evensong | Title: The Dancer | Title: The Sun In The Stream | |
| Artist: David Lanz | Artist: Secret Garden | Artist: Wayne Gratz | Artist: Enya |
[intent]:add_filter [music_attribute]:similar_track:Breeze From Saintes Maries by Jesse Cook
[USER]: I'd like to explore songs similar to 'Breeze From Saintes Maries' by Jesse Cook.
[intent]:feedback_request,passive_recommend
[SYSTEM]: I'll recommend some tracks similar to 'Breeze From Saintes Maries' by Jesse Cook. Feel free to let me know your thoughts after listening.
| Title: White Buffalo | Title: Bright Light | Title: Divertimento | Title: Rotation | |
| Artist: Cusco | Artist: Bernward Koch | Artist: Secret Garden | Artist: Bernward Koch |
[intent]:add_filter,accept_response [music_attribute]:artist:Jesse Cook
[USER]: I enjoy music by Jesse Cook. Can you recommend more songs by this artist?
[intent]:passive_recommend
[SYSTEM]: Glad to hear you like Jesse Cook's music. Let me suggest more tracks by Jesse Cook for you.
| Title: Canción Triste | |
| Artist: Jesse Cook |
[intent]:add_filter,accept_response [music_attribute]:similar_track:Canción Triste by Jesse Cook
[USER]: I appreciate the recommendations! Could you also suggest music similar to 'Canción Triste' by Jesse Cook?
[intent]:passive_recommend
[SYSTEM]: Certainly! I'll provide you with more music similar to 'Canción Triste' by Jesse Cook.
| Title: Closer To Madness (Live) | Title: Down Like Rain | Title: Soledad | Title: Switchback | |
| Artist: Jesse Cook | Artist: Jesse Cook | Artist: Jesse Cook | Artist: Jesse Cook |
UUID: a5423e66-ccdc-4d1f-a152-4de7b1d7c4e1
[intent]:initial_query,add_filter [music_attribute]:genre:hip hop
[USER]: I'm interested in exploring hip hop music.
[intent]:parroting_response,passive_recommend
[SYSTEM]: I will recommend some hip hop music for you to enjoy.
| Title: Little Man (Part 1) | Title: Brooklyn In My Mind | Title: La Placa | Title: Dollar Bill | |
| Artist: SkinnyMan | Artist: 9th Wonder | Artist: Psycho Realm | Artist: Diamond D |
[intent]:add_filter,accept_response [music_attribute]:genre:alternative rap
[USER]: I like the genre of alternative rap. Thank you for the recommendations.
[intent]:parroting_response,passive_recommend
[SYSTEM]: I see you prefer alternative rap. Let me find more music in that genre for you.
| Title: Night Life | Title: I Want You | Title: Service | Title: Work The Angles | |
| Artist: Dilated Peoples | Artist: Common | Artist: Dilated Peoples | Artist: Dilated Peoples |
[intent]:add_filter,accept_response [music_attribute]:mood:witty
[USER]: I'm in the mood for witty music.
[intent]:parroting_response,passive_recommend
[SYSTEM]: Noted. I will look for music with a witty mood to suit your current preference.
| Title: Totally Tanya | Title: Words From the Krayo (feat. Krayola) | Title: The Art Of Getting Jumped | Title: Crown Royal | |
| Artist: Dynas | Artist: Junk Science | Artist: Steinski | Artist: Dynas |
[intent]:add_filter,accept_response [music_attribute]:popularity:high popularity
[USER]: I prefer music with high popularity.
[intent]:parroting_response,passive_recommend
[SYSTEM]: Understood. I will recommend some highly popular music for you.
| Title: His Name Is Mutty Ranks | Title: The Love | Title: Quality Control | Title: Break | |
| Artist: A Tribe Called Quest | Artist: A Tribe Called Quest | Artist: Jurassic 5 | Artist: Jurassic 5 |
[intent]:add_filter [music_attribute]:artist:Gorillaz Featuring De La Soul And Bootie Brown Of The Pharcyde
[USER]: I would like to explore music by Gorillaz featuring De La Soul and Bootie Brown of The Pharcyde.
[intent]:parroting_response,passive_recommend
[SYSTEM]: I will find music by Gorillaz featuring De La Soul and Bootie Brown Of The Pharcyde for you.
| Title: Dirty Harry | Title: Empire Ants (Feat. Little Dragon) | Title: Welcome To The World of The Plastic Beach (Feat. Snoop Dogg and Hypnotic Brass Ensemble) | Title: Rhinestone Eyes | |
| Artist: Gorillaz | Artist: Gorillaz | Artist: Gorillaz | Artist: Gorillaz |
UUID: a1c9bc63-c0a5-4b03-86bd-e78d33d0d3d5
[intent]:initial_query,add_filter,greeting [music_attribute]:genre:rap
[USER]: Hey there! I'm interested in exploring rap music, specifically in the rap genre.
[intent]:sympathetic_response,detail_attribute_request
[SYSTEM]: I understand your interest in rap music. Can you provide more details or preferences about the type of rap music you enjoy?
| Title: The Perfect Storm | Title: Save Yourself | Title: Ma cité a craqué (feat. Lony) | Title: My To My | |
| Artist: Mathematik | Artist: Aesop Rock | Artist: Poison | Artist: Mor W.A. |
[intent]:add_filter [music_attribute]:mood:boisterous
[USER]: I'm looking for rap music with a boisterous mood.
[intent]:sympathetic_response,detail_attribute_request,parroting_response
[SYSTEM]: It sounds like you want rap music with an energetic vibe. Could you elaborate more on your preferences for boisterous rap music?
| Title: Rebel Music (3 O'Clock Roadblock) | Title: Money-Long | Title: The Big East | Title: Style Wars | |
| Artist: Spearhead | Artist: Kottonmouth | Artist: Masta Ace Incorporated | Artist: Masta Ace Incorporated |
[intent]:accept_response,add_filter [music_attribute]:decade:2000s
[USER]: I like the suggestion! I'd also like to explore rap music from the 2000s.
[intent]:passive_recommend,detail_attribute_request
[SYSTEM]: Great choice! Let me recommend some rap music from the 2000s. Do you have any other criteria in mind for the music you want?
| Title: 5 Million Ways To Kill A C.E.O. | Title: 100_000 Indi | Title: Mooore | Title: Lifestyles | |
| Artist: The Coup | Artist: Hieroglyphics | Artist: Aceyalone | Artist: The Dirtball |
[intent]:accept_response,add_filter [music_attribute]:theme:hanging out
[USER]: I enjoy the vibe! Can you recommend rap music suitable for hanging out?
[intent]:parroting_response,passive_recommend
[SYSTEM]: I see you enjoy rap music for hanging out. Let me suggest some tracks that fit the theme. Feel free to let me know your thoughts on them.
| Title: Say It Again (Amended Version) | Title: Stoic Response | Title: Rhythm Sticks (Album Version) | Title: Fan Mail | |
| Artist: Little Brother | Artist: Haiku D'Etat | Artist: Blackalicious | Artist: AZ |